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Abstract 

This paper summarizes the fundamental expressiveness, closure, and decid- 
ability properties of various finite-state automata classes with multiple input tapes. 
It also includes an original algorithm for the intersection of one-way nondetermin- 
istic finite-state automata. 
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1 Overview 



This paper is a survey of the known results about the expressiveness, closure, and decid- 
ability properties of finite-state automata that read multiple input tapes. The theoretical 
study of these computing devices began within the classic work of Rabin and Scott 1 16 1, 
Elgot and Mezei |5|, and Rosenberg ifTTl [TSl l6l . In recent years, multi-tape automata 
have found some applications such as automatic structures ifTJI (20) |2] [19l , querying 
string databases |7|, and weighted automata for computational linguistic fT2l[3l. 

Section [2] gives a general definition of multi-tape automata that allows for nonde- 
terministic, asynchronous, and two-way movements of the input heads. The following 
sections analyze the expressiveness, closure properties, and decidability for increasing 
levels of generality: Section [3]briefly recalls the well-known properties of single-tape 
automata; Section]?] discusses synchronous automata, where different input heads are 
not allowed to be in arbitrary portions of their respective tapes; and Section]5]considers 
the most general case of fully asynchronous heads. Section ]6] gives a synopsis of the 
fundamental properties surveyed. 

Finally, Section]7]presents an original algorithm for the intersection of asynchronous 
one-way multi-tape automata. Since this class is not closed under intersection, the al- 
gorithm may not terminate in the general case. 



2 Definitions 

2.1 Alphabets, Words, and Tuples 

Z is the set of integer numbers, and IN is the set of natural numbers 0, 1, . . .. For a 
(finite) set S, p{S) denotes its powerset. For a finite nonempty alphabet S, S* denotes 
the set of all finite sequences ai . . . (t„, with n > 0, of symbols from S (also called 
words over E); when n = 0, e e E* is the empty word. |s| e IN denotes the length n of 
a word s = ci . . . (T„. An n-word is an n-tuple (xi, . . . , Xn) G (E*)" of words over 
E, where each = ai^i . . . (Tni,i- 

The convolution of n words (xi, . . . , a;„) is a word over the padded alphabet (E U 
{□})": 



xi (g) • • • (g) a;„ = 



' y\ ' 




' yT ' 






. yn . 



where m is the maximum length max{|xi|, . . . , |a;„|}, and 

^ J the /i-th component of Xh,k of x^ h < \xk \ , 
^'^ I □ otherwise . 

Given two words x — xi . . . Xn and y = yi ... ym, x o y denotes their concate- 
nation xi . . . Xnyi ... ym, and rev{x) denotes the reversal Xn ■ ■ ■ xi of x. These 
operations on words are naturally Ufted to sets of words and to n- words; for example, 
W o X — {w o X \ w G W,x G X} denotes the concatenation of the two sets of 
words W and X; rev{{)x) = {rev{xi), . . . , rev{xn)) denotes the reversal of the n- 
word ) . Also, W* denotes the Kleene closure with respect to finite 

self-concatenation, that is W* = UfcgiN where 

k 

= W oW 0---0W . 
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Given a set W of n-words over E, W is the complement set (S*)" \ W; 3kW is 
the projection set of n — 1-words obtained by projecting out VF's /c-th component, that 
is 

{3y(a;i, . . . , Xk-i,y, Xfc+i, . . . a;„) G M^, 
(yi, . . . ,y„-i) I xi=yi,.. .,Xk-i = y^-i, 
Xk+l =yk,---,Xn^ Vn-l 

VkW is the generalization set of n — 1-words obtained for every value of W's k-th 
component, that is 

{yy{xi, . . . ,Xk^i,y,Xk+i, ...Xn)eW, 
{yi, ■ ■ ■ ,yn-i) I xi=yi,.. .,Xk-i = yk-i, 
Xk+l ^ yk, ■ ■ ■ ,Xn = yn-1 

and the convolution of W is the set of words 

W'^ = {xi<^---(dXn \ {xi,...,Xn) G W} . 

2.2 Multi-Tape Finite Automata 

A two-way finite-state automaton with n > 1 tapes scans n read-only input tapes, each 
with an independent head. At every step, the transition function determines the possible 
next states and head movements, based on the current state and the symbols currently 
under each head. Two special symbols [>, O respectively mark the left and right ends 
of each input tape; S|><| denotes the extended alphabet E U {>, <}. 

Definition 1. A two-way nondetenninistic finite-state automaton with n tapes is a tuple 
(S,(3,(5, go, where: 

• I] is the input alphabet, such that [>, <l ^ E; 

• Q is the finite set of states; 

• 5 : Q X — )■ p(Q x { — 1, 0, 1}") is the transition function that maps current 
state and input to a set of next states and head movement directions, with the 
restriction that the head does not move past the end markers; 

• go e Q is the initial state; 

• -F C Q is the set of accepting states. 

The semantics of two-way nondeterministic finite-state automata relies on the no- 
tion of configuration. Given a two-way nondeterministic finite-state automaton A as in 
Definition [T] a configuration of A is a (2n + 1) -tuple 

(a;i,...,a;„,g,ii,...,i„) G ([> E* <)" x g x IN" , 

where q G Q is the current state, and, for 1 < k < n, Xk is the content of the /c-th 
tape and < ifc < \xk\ + 1 is the position of the A;-th head; when ik — (resp., 
T-k = \xk\ + 1) the head is on the left marker \> (resp., right marker <). 
The transition relation h between configurations is defined as: 
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if and only if, for each I < k < n, (7i^_k is the symbol at position ik in input word 
Xk, S{q, (Tij^^i, . .. , (Ji^^n) includes a tuple (g', di, . . . , d„), and i'^ = ik + dk for each 
1 < fc < n. 

A run p of A on input x ~ {xi, . . . , x„) is a sequence of configurations xo ■ ■ ■ Xm 
such that Xo = (a;, 9o; 0") and, for all 1 < A; < m, Xk-i ^ Xk- run p of ^ on input 
X is accepting if Xm = {x,q,ii, ■■■ ,in) for some q G F and the i^t-th character of the 
k-th tape is O (that is, every head has reached the end of its tape). Correspondingly, A 
accepts an input word x if there is an accepting run p of A on x. The language accepted 
(or recognized) by A is the set of n-words 

jC{A) = {xe (S*)" I A accepts x } . 

Definition 2. An n-tape automaton A is: 

• deterministic if \6{q, ai, . . . , cr„)| < 1 for any q,ai,..., a^, 

• s-synchronized for s > if every run of A, accepting or not, is such that any two 
heads that are not on the right-end marker <\ are no more than s positions apart 
(as measured from the left-end marker >); 

• synchronized if it is s-synchronized for some s e IN; 

• asynchronous if it is not synchronized; 

• synchronous if it is 0-synchronized; 

• r-reversal bounded for r > if every run of A, accepting or not, is such that any 
head never inverts its direction of motion more than r times; 

• reversal-bounded if it is r-reversal bounded for some r G M; 

• one-way if it is 0-reversal bounded, that is 5 never moves any head left; 

• with rewind if it only makes a special type of reversals where, after all heads 
reach the right-end marker <, they are simultenously rewinded to the left-end 
marker >, where the computation continues; 

• r-rewind bounded for r > if it is 2r-reversal bounded with rewind; 

• rewind-bounded if it is r-rewind bounded for some r e W. 

Correspondingly, NFA(n, s,r) denotes the class of s-synchronized r-reversal 
bounded n-tape two-way nondeterministic finite-state automata, DFA(n, s, r) the cor- 
responding deterministic class, and when s = oo (resp. r = oo) the class includes 
asynchronous (resp. two-way reversal-unbounded) automata as well. Finally, for R e 

W U {oo}, NFA^n, s, Rj and DFA^n, s, denote the classes of nondeterministic 
and deterministic s-synchronized R-rewind bounded (or unbounded if R = oo) n-tape 
two-way finite-state automata. 

With a little abuse of notation, the notation for automata classes also denotes to the 
corresponding class of accepted languages; for example, NFA(3, oo, 4) is also the class 
of languages recognized by nondeterministic 3-tape machines with at most 4 reversals 
and with no synchronization restrictions. 
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2.3 Weak Inclusions 

A number of weak inclusions are a direct consequence of the definitions. In the fol- 
lowing, let n > 1 be a number of tapes, s,r e IN be nonnegative integers, and 
S, R e IN U {00} be nonnegative integers or infinity. Determinism is a syntactic re- 
striction, thus: 

DFA(n, S, r) C NFA(n, S, r) ; (1) 
and similarly, bounding the number of reversals reduces generality: 

DFA(n, S, r) C DFA(n, S, r + 1) C DFA(n, S, od) , (2) 
NFA(n,S,r) C NFA(n,S,r + 1) C NFA(n, S,cx)) ; (3) 

and so does limiting the degree of synchrony: 

DFA(n, s, r) C DFA(n, s + 1, r) C DFA(n, 00, r) , (4) 
NFA(n, s,r) C NFA(n,s + 1,r) C NFA(n,oo,R) . (5) 

Rewinds are a restricted form of reversals, hence: 

DFA(^n, S, R^ C DFA(n,S,2R) , (6) 
NFA(n, S, r) C NFA(n, S, 2r) . (7) 

2.4 Decision Problems 

Given a class C of languages, and n-tape automata A, B, consider the following deci- 
sion problems: 

Emptiness: does C{A) = 0? 
UniversaUty: does (E*)"? 
Finiteness: is C{A) finite? 
Disjointness: does C{A) n C{B) = 0? 
Inclusion: does C{A) C C{B)7 
Equivalence: does £{A) = C{B)1 
Class membership: does C{A) e CI 

3 Single-Tape Automata 

This section recalls the well-known properties of single-tape automata (that is, with 
n = 1 tapes), which define the class of regular languages lfT6l [TOl [l4ll . Clearly, the 
notion of synchronization is immaterial with a single tape: 

DFA(1,0,0) = NFA(1,0,0) = DFA(1,s,r) = NFA(1,s',r') . (8) 

Also, languages defined by one-tape automata are closed under complement, inter- 
section, union, concatenation, Kleene closure, projection, generalization, and reversal. 
The emptiness, universality, finiteness, disjointness, inclusion, equivalence, and class 
membership problems are all decidable for regular languages. 
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4 Synchronized Multi-Tape Automata 



This section studies several properties of synchronized multi-tape automata NFA(ri, s, r) 
and DFA(n, s, r), where s denotes a generic value in IN, and R a generic value in 
M U {oo}. As we will see, synchronization essentially makes multi-tape automata 
defining regular languages over convolutions, hence synchronized multi-tape automata 
define a very robust class of languages. 

4.1 Expressiveness 

This section shows that: 

DFA(n, 0, 0) = NFA(7i, 0, 0) = DFA(n, s, r) = NFA(n, s, r) . (9) 
Since rewinds are a special case of reversals, it also follows that: 

DFA(n,0,0) = NFA(n,0,0) = DFA(n,s, r) = NFA(n,s, r) . (10) 



4.1.1 Increasing Synchronization 

Every synchronized n-tape automaton can be transformed to an equivalent synchronous 
71-tape automaton: 

NFA(n,s,R) = NFA(n,0,oo) . (11) 

The construction to translate an A G NFA(n, s, r) into an A' G NFA(n, 0, r) gener- 
alizes the one in ifTTl to two-way nondeterministic automata; to our knowledge, it is 
original to the present survey. It works as follows: additional states in the synchronous 
automaton A' keep track of the "neighbour" s symbols on each tape scanned during a 
synchronous reading of the tapes. 

Precisely, the states Q' of A' are of the form [q,bi, . . . , 6„], where each bk is a word 
of at most s + 1 characters over S|><| U {I}, with exactly one occurrence of the special 
symbol I- For any such words b, 4(6) denotes the character immediately to the right of 
I, or e if 4 is the right-most character in b. 

Then, a configuration of A' where the symbol currently under the fc-th head is ak 
and the current state is [q,bi, . . . , 6„], corresponds to a configuration of A where the 
symbol currently under the k-th head is 1(6^ • o-fc) — that is the one immediately to the 
right of l in b^ ■ cru — and the current state is q. 

The initial state of A' is [go, i"], where all heads are on the left marker. During 
any computation over a given input, the (common) position of the heads in A' corre- 
sponds to the position of the right-most head in A; more precisely, the states of A' plus 
the input describe a n x (A; + 1) tape portion: 

ai Xi i yi /3i cr[ 
ctk Xk i Vk Pk <y'k 

where E '^t-< left-most stored portion of the fc-th tape, £ {e} U S|><i is 
the chai^acter immediately to the left of the maiter, yk G {e} U S|><| is the character 
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immediately to the right of the marker, l3k G S><| is the right-most stored portion 
of the A:-th tape, and a'j^ S Ex is the charater currently under the A:-th head. The 
hypothesis that A' is s-bounded entails that 2 < \akXk i 2/fe /3fc o"^ | < s + 2. Finally, 
when a head is on the right marker <l, we call it "inactive", and we do not update the 
corresponding portion of the state. Write I to denote the set of inactive heads in the 
current state (that is, the set of heads h such that ah ■ (Th G 'S* < and UhXh ^ e), and 
H = {1, . ■ ■ ,n} \ X to denote the other active heads. 

Let us now see how to construct the transitions of A'. For each of A's transitions 

{q',di,...,dn) e S{q,ai,...,an), 

consider all states of A' of the form [q,ai, . . . , a„]. A' should make a transition from 
such current state according to the characters currently marked by 4-, corresponding 
to the (Tj, and then adjust the state to reflect the head movements in A. If all active 
heads move left in A (that is, m'Ax{dj \ j G H} = — 1) and there exist an active tape 
k whose s-size buffer encoded in the state has the marker 4- in the leftmost position 
(a^: = xj. = e), then it is not sufficient to rearrange the information in [q,a\,..., o„] 
to determine the next state A' moves to, because the new character the head moves 
is to s + 1 characters away from the current position of the head in A' . Hence, in 
these situations. A' enters a sequence of lookup states . . . , C.'^j_-^ while moving all 
its active heads left, until it reads the (,s + l)-th character to the left, so that it can update 
the state accordingly. Precisely, the following transitions in A' define a lookup, for any 
characters /xi, . . . , /i„ read while moving heads. 

• Enter the lookup state and start moving left: 

([£]", ai, . . . , an],\i^'°, K^'°) e 5'{[q, ai, . . . , a„], in,..., Mn) , 
where 

■' \b otherwise , 

hence inactive heads are not moved. 

• Traverse all lookup states, for 1 < /i < s, while moving left: 

{[(■l+i, ai, • • • , an],Xi^'°, K^^°} e <5'([^ft , ai, • • • , a„], /ii, . . . , 

• Include the current characters /Ui , . . . , /i„ in the state and start moving right on 
the "duplicate" lookup state if: 

{[ef, ui,..., Un], XY°, Xl/°) e ai, . . . , a„], Ml, . . . , Mn) , 

where Vk is X'^''^'^ ■ Uk, with the last character removed if |A^''^'^ ■ ak\ > s + 1. 

• Move right, for s > h > 1, until you reach i'^: 

{[ih-1,'^1, ^n], X\'°, Xl/°) e S'{[el, Ui,..., Un\,IJ.l, ...,Hn) 

• Move to the original position on q: 

{[q, ui,..., u„],Xl^°, Xl/°) e S'{[£f, ui,..., iy„],iJi, . . . ,/Xn) . 
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Notice that, after the lookup, the tuple i^i , . . . , is certainly different than the 
starting tuple ai, . . . , a„, because we have added a left-most character to the 
left of the marker I in at least one of ai, . . . , a„. Hence, the lookup does not 
introduce nondeterminism. 

After setting up the lookup when necessary, let us now describe normal transitions 
of A'. Let [q,ai, . . . , a„] be the current state; add to A' all transitions of the form 

{W,a[,...,a'^],xf^°,-.-,Xi/°)eS'{[q,a^,...,ar.],a[,...,a'J 
such that, for 1 < k < n: 

• d' = max{(ij | j e %}; 

• Cfe =i(afe -CT^) or, if | does not appear in ak (this may only happen after a lookup 
when the | occurred at the last position in ak), (Jk = cj,; 

• Let 7fe be • ct^. with | moved right, left, or not moved, according to whether 
dk is 1, —1, or 0; formally: 



Ik 



Then, a'u is: 



ctk Xk Uk i Pk o-'k 
ak Xk (j'k i 
ctk Xk i Uk fik (j'k 
ak i Xk Uk fik cr'k 
ak i a'^. 



Ik 



dk ^ land yk^e, 

dk = I and yk = e = Pk, 

dk = 0, 

dk = —1 and I appears in ak ■ cr'^. , 

dk = —1 and I doesn't appear in flfc • tr^ , 



7fc without the first character 
7fc without the last character a'^ 



\lk\ < s + 1 andd' = 1, 
|7fc| > s + 1 and d' = 1 , 
d' < 0. 



Remarks. 

• With this construction the number \Q'\ of states of A' is 0(|Q| • • s|i;|), 
because there are at most n-tuples of words of length at most s for each 
state in Q, plus a multiplicative factor s • jSj to account for the lookup states 
(2s + 1, for any possible left-most characters Hk € S|><|). 

• The lookups may introduce additional reversals, therefore the construction does 
not, in general, preserve the original value R of reversals. 

• Automaton A' is deterministic if and only if A is. Therefore, the same construc- 
tion proves: 

DFA(n, s, r) = DFA(n, 0, oo) . (12) 



4.1.2 Removing Reversals 

The classic constructions to turn two-way automata into equivalent one-way automata 
(such as Shepherdson's [ 21] or Vardi's 122|) are applicable to multi-tape synchronous 
automata as well. The only minimal difference is that a multi-tape one-way automaton 
is not forced to always move its heads right, because the heads reaching the right-hand 
marker <l cannot move right at all. In all, the following result holds: 

NFA(n,0,R) = NFA(n,0,0) . (13) 
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4.1.3 Determinization 

The usual construction to determinize nondeterministic finite-state automata works for 
multi-tape synchronous automata too: 

DFA(n, 0, 0) = NFA(n, 0, 0) . (14) 



4.1.4 Convolution 

The computations of synchronous n-tape one-way automata can be regarded as compu- 
tations of single-tape automata over n-track alphabets. More precisely, let C{A) be the 
language over alphabet S accepted by some synchronous n-tape one-way automaton 
A e NFA(n, 0, 0). Then, there exists a single-tape one-way automaton B that accepts 
the language C{A)'^. 



4.2 Closure Properties 

Since synchronized automata essentially define regular languages via convolution, they 
enjoy the same closure properties. Thus, the usual constructions |10| show that 
NFA(n,0,0) is closed under under complement, intersection, union, concatenation, 
Kleene closure, projection, generalization, and reversal. 



4.3 Decidability 



Decidability of most decision problems considered in Section 2.4 is also a straight- 
forward consequence of the regular nature of synchronized automata: for example, 
emptiness is decidable: construct the automaton recognizing C{A)'^ and determine if 
it accepts some word; alternatively, directly test reachability of an accepting state. Sim- 
ilarly, it is easy to see that universality, finiteness, disjointness, inclusion, and equiva- 
lence are decidable for synchronized automata. 

Next, we consider some class membership problems. Ibarra and Tran [11, Th. 15] 
show that, for generic two-way automaton A e NFA(n, oo, oo) and s > 0, it is de- 
cidable to determine whether A e NFA(rt, s, oo), that is whether A is s-synchronized. 
The idea is to build an automaton M that simulates the computations of A on a single 
tape that stores the convolution of the input; whenever M detects a computation where 
a pair of heads would "separate" more than s cells apart, it accepts, and otherwise it 
rejects. Since M accepts the empty language if and only if A is not s-synchronized, 
and emptiness for M is decidable (as M is a single-tape automaton), it follows that 
we have an effective procedure to determine whether A e NFA(ri, s, oo). The same 
procedure is applicable to automata with bounded reversals, hence it is also decidable 
whether A e NFA(n, s, r) for given s e and R e IN U {oo}. 

Ibarra and Tran ifTTl Th. 14] also show — via reduction from the halting problem of 
2-counter machines — that, for a generic two-way automaton A S NFA(n, oo, oo), it 
is undecidable to determine whether A is synchronized (for some s G IN). However, 
if A E DFA(n, oo, 0) is one-way deterministic, then the same problem is decidable, 
because A is asynchronous unless it is {q — 1) -synchronized, where q is the number 
of A's states. Since we notice that the determinization construction of single-tape au- 
tomata is applicable to deterministic one-way multi-tape automata as well, we have 
that the problem of deciding whether a generic A € NFA(n, oo, 0) is synchronized is 
also decidable. 
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On the other hand, the following problem is undecidable (for n > 1) ifTTl Th. 11]: 
given A £ NFA(n, oo, 0), determine whether C{A) e NFA(n, s, 0) with s given or not 
(the two problems are both undecidable because of the result (|9]i: every s-synchronous 
language is also 0-synchronous), that is whether A recognizes a synchronous language. 
Undecidability immediately extends to the two-way case (also with bounded reversals). 
The decidability of the corresponding problems for deterministic one-way automata is 
currently open. 

5 Asynchronous Multi-Tape Automata 

This section studies several properties of asynchronous multi-tape automata NFA(n, oo, r) 
and DFA(n, oo, r), where R denotes a generic value in IN U {oo}, and n > 2. Asyn- 
chrony significantly increases the expressiveness of multi-tape automata, but it also 
significantly restricts the decidability and closure properties. 

5.1 Expressiveness 

This section shows that: 

NFA(n,s,R) C DFA(n,oo,0) C DFA(^n,cx),'r^ C DFA(^n,oo,r + 1^ , (15) 

DFA(^n,oo, r"^ C NFA^^n, oo, ^ C NFA^^n, oo, r + 1^ , (16) 

DFA(^n,oo, o") = DFA(n,oo,0) C NFA(n,oo,0) = NFA(^n, oo, o') , (17) 
and, for r > 1, 

NfA(n, oo, 'P) C DFA(n, oo, 2r) C NFA(7i, oo, 2r) , (18) 



N 



FA(n,oo,0) and DFA^n, oo, r ^ are incomparable. (19) 



5.1.1 Asynchronous More Expressive Than Synchronous 

There exist asynchronous languages that no synchronous automaton recognizes, thus: 
NFA(n, s, r) = DFA(n, s, r) C DFA(n, oo, 0) . (20) 
In fact, consider the language over pairs of strings 

Ln,2n = {{a",a^")\neK}- 

It is clear that L„ 2n G DFA(n, oo, 0), because the automaton in Figure [T| recognizes 
it; notice that the automaton is indeed asynchronous, as the second head makes twice 
as many moves as the first one, and both scan the entire tape upon acceptance. On the 
contrary, 

7-«l 

is not regular, hence L„ 2ri is not accepted by any synchronous 2-tape automaton be- 



{ 


a 


n 




1 n e in| 




a 




a 





cause of the results of Section 4.1.4 Since we can always extend L„^2n to an n-word 
language with all components empty but the first two, the separation of synchronized 
and asynchronous holds for every n > 2. 



11 



5.1.2 Expressiveness Increases With Rewinds 



The power of asynchronous multi-tape automata increases with the number of rewinds: 

DFA(^n,oo, r"^ C DFA(^n, oo, r + 1^ , (21) 

NFA(^n,oo, C NFA^^n, cx),r + 1^ . (22) 

Collectively, rewind-bounded automata are instead as expressive as rewind-unbounded 
ones: 

(J DFA(^n,cx),'r^ = DFA(^n, oo, oo^ , (23) 

y NFA(n,(X),^^) = NFA(n,(X),(S) . (24) 

These results have been proved by Chan ^ Ch. 4]. Consider first deterministic 
rewind-bounded automata. Given any 2^ distinct positive integers 

< fci < fc2 < • • • < ^2'- , 

consider the language 

L2" = {(a'",a''' ™) I m e ]N,1 < i < 2''}. 



It is not difficult to show that L2'' G DFA(^2,oo, r j: each language {(a'",a ) | 

m E IN} is recognizable without rewinds, and the r rewinds can implement a binary 
search among all 2'' different values of ki,k2, ■ ■ ■ , k2r-. The standard argument that 
binary search of 2'' elements requires, in the worst case, r comparisons, carries over 
to this setting of r-rewind automata, hence allowing us to prove that r rewinds are 
necessary to recognize i2'- ■ The argument clearly extends to an arbitrary number of 

tapes, thus separating DFA^n, 00, from DFA^n, 00, r + 1^ for all finite r's. 

Let us now consider nondeterministic rewind-bounded automata. The argument 
for deterministic ones breaks down, as we can use nondeterministic parallelism to try 
out all 2*" values of k. More generally, every language over unary alphabet that is 
accepted by a reversal-bounded n-tape automaton is also accepted by some one-way 
n-tape nondeterministic automaton (that can be constructed effectively, see Chan H 
Th. 4.1]). However, inclusion is still strict for larger alphabets. For m > 2, consider 
the 2-word language 

io/i,m = {{xi#X2# ■ ■ ■ #a;„i,x„#x„j_i# • • • \xi,.. .,x„i S {0, 1}*} . 

a, a/0, 1 



<,</0,0 



a, a/1, 1 



Figure 1: A 2-tape asynchronous automaton recognizing the language L„,2; 
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It is clear that Lo/i.m is accepted by a deterministic (m — l)-rewind bounded automa- 
ton. Chan proves, using Yao and Rivest's technique |23|, that no nondeterministic au- 
tomaton with only m — 2 rewinds can accept io/i,m- Since a deterministic automaton 
is a special case of a nondeterministic one, we have a separation of NFA(2, oo, to — 2) 
and NFA(2, oo, to — 1) (which, as usual, extends to a generic number of tapes). 

Finally, Rosenberg first observed 1 18] that bounding the number of rewinds is with- 
out loss of generality for deterministic automata: if, in some computation, an automa- 
ton re-enters the same state after two rewinds, it has entered an infinite loop (and hence 
will not accept the input). The pigeonhole principle implies that an automaton must 
re-enter the same state after a number of rewinds equal to the number of its internal 
states. Thus, a finite bound on the number of rewinds (equal to the number of internal 
states) does not limit the expressiveness of deterministic automata. A very similar ar- 
gument works for nondeterministic automata too (as observed by Chan): an input can 
be accepted only if there exists some computation where a different state is entered 
after each rewind; therefore, every accepting computation has bounded rewinds. These 
arguments prove ( |23] l and ( |24| i. 



5.1.3 Expressiveness and Reversals 

It is currently unknown whether a hierarchy on to the number of reversals exists, sim- 
ilar to the hierarchy on the number of rewinds discussed in the previous section. In 
particular, it is unknown whether the inclusions DFA(?7, oo, r) C DFA(n, oo, r + 1) 
and NFA(n, oo, r) C NFA(ri, oo, r + 1) are strict for every r. The standard conjecture 
is that they are, but the capabilities of reversals are quite difficult to capture exactly 
for asynchronous automata. In particular, Chan f?', Sec. 4.3] showed that the hierar- 
chy collapses for nondeterministic automata over unary alphabet, since these automata 
precisely define the set of unary encodings of Presburger relations, regardless of the 
number of reversals; thus, a separation in the general case requires languages over 
binary alphabets. 



5.1.4 Nondeterminism Not Replaceable by Rewinds 



Nondeterminism is not replaceable by rewinds in general. Consider the language L2 



introduced in Section 5.1.2 a deterministic automaton needs r rewinds to recognize it, 
but it is clear that a nondeterministic automaton needs no rewinds, as it can just guess 

the right value of k (if it exists). This shows that NFA(n, 00, 0) \ DFA^^n, 00, is not 

empty, for each r > and n > 2. 

Chan [4, Th. 4.6] proves a stronger result: there exist languages accepted by one- 
way nondeterministic automata that no deterministic automaton with (arbitrarily many) 
rewinds accepts. The language 



Ul * wi# • • • #u 



/ Ml,. 


■ • 7 1 ^ 


Vi, . 


• ■ 7 '^m 7 


Xi, . 


■ • 7 -^n 1 


\ yi, ■ 


■ • , y« / 







e{o,i}- 



is an example that belongs to the non-empty difference 
NFA(n,oo,0)\ y DFa( 



n, 00, r 



(25) 
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Rosenberg ifTSl Th. 9] shows a simpler language that belongs to the set difference 
( p5| l. Consider the two languages 



B = {{xa,e) I X € {a,b}*} , 
C = {(^^.b") I m e IN}, 

and their concatenation 

A = BoC= {{xab"',b"')\me¥!,x£{a,b}*}. 

It is clear that both B and C are in DFA(2,oo,0). On the contrary, A is not in 
DFA^2, oo, for any r > because a deterministic automaton cannot "guess" where 
the tail of fe's starts on the first tape; rewinds do not help, because the tail can be ar- 
bitrarily long, while the number of rewinds is bounded by the finite number of states 
of the automaton (as we observed in Section |5.1.2[ ). For the same reason, A is in 
NFA(2, oo, 0), where a nondeterministic choice guesses where the tail starts. 



5.1.5 Rewinds Not Replaceable by Nondeterminism 



Rewinds are not replaceable by nondeterminism in general, as first proved by Rosen- 
berg ifTSl Th. 9]. We can easily show it using the language 



^{{a"'ba^ 



'ba" 



GIN}, 



discussed later in Section 
can make a pass to check 



5.2.1 



Lm.m is in DFA^2, oo, 1 j : a deterministic automaton 
that the two input strings are identical and in the form a* ba* ; 
then, it rewinds and makes another pass to check that the sequence of a's before the b 
on the first tape has the same length as the sequence of a's after the b on the second tape. 
However, L^jn is not in NFA(2,oo,0), because nondeterminism does not help here 



(Section 5.2.1 gives a more rigorous characterization of why this is the case). Hence, 
the difference 

IJ DFA(n,oo,V) \ NFA(n,oo,0) (26) 



is not empty. 



5.1.6 Reversals Not Replaceable by Rewinds 

Reversals are not replaceable by rewinds in general, not even when combined with 
nondeterminism. The 2-word language 

Lp = {{x,rev{x)) | a; G {0, 1, #}*} 

is clearly recognizable with a 1 -reversal bounded deterministic automaton. No automa- 
ton with rewinds and nondeterminism, however, can accept Lp. Otherwise, let M be 
such an automaton, and let fi be the number of its rewinds; we could then use M to 
recognize a language similar to ^q/i „ for m = /i + 2, but where the word on the 
second tape is the reversal of the one on the first; this is impossible with n rewinds, as 
shown by same argument that showed that Lp/i m is not accepted with less than m — 1 

rewinds. The contradiction shows that the difference DFA(n, oo, 1) \ nfa( n, oo, R I 
is not empty. 
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5.1.7 Determinism vs. Nondeterminism 

Whether reversals can replace nondeterminism is an open problem in general; in par- 
ticular, it is unknown whether the inclusion DFA(n, oo,r) C NFA(n,oo,R) is strict 
or not. Some related results for single-tape multi-head automata might suggest that it 
is. For example, Bebjak and Stefanekova H] show some functions /(m) (where m 
is the length of the input) such that /(m) -reversal bounded n-head nondeterministic 
automata are strictly more expressive than their deterministic counterparts. The gen- 
eral question for n-head automata is Ukely hard to settle, as it corresponds |[9l to the 
open problem of whether deterministic logarithmic space (L) equals nondeterministic 
logarithmic space (NL). 

5.2 Closure Properties 

This section presents the closure properties of multi-tape finite automata. We start with 
one-way automata, and then introduce rewinds and reversals. 

5.2.1 Deterministic One- Way Automata 

Let us consider the closure properties of the class 2?„ = DFA(n, oo, 0), for n > 2. 

Rabin and Scott observed |16 Th. 17] that 2?2 is closed under complement, with 
the usual construction that complements the accepting states (with a transition function 
that is total). The same construction carries over to show that 2?„ is closed under 
complement for any n. 

Vn is not closed under projection, but we have the weaker property that if L G 2?„ 
then 3fcL £ Mn-i- Rabin and Scott proved this lfT6l Th. 16] for n = 2, and other 
authors ll5ll6l [T5l generalized it. The idea of the proof is the following: given an 7i-tape 
automaton A, build an n — 1-tape automaton B that replicates A's behavior on all tapes 
except the fc-th (which is projected out), where it behaves nondeterministically (that is, 
it performs any computation A may perform on the fc-th tape). 

Since 2?„ is closed under complement but not under projection, it is also not closed 
under generalization: the projection 3feL of a language L E P„ is equivalently ex- 
pressed as Vfci, hence if 2?„ were closed under generalization, it would also be closed 
under projection — a contradiction. 

2?„ is not closed under intersection. For example, Rabin and Scott lfT6l Th. 17] 
suggest the 2-word language: 

L„ „ = {{a"'ba"',a'^ba"') | m e F} 

= n L^^^ = {(a'"6a'', a'=6a") \ m,h,k e ]N} D {{x,x) \ x e {a, b}*} . 

Clearly L„i E 2?2 and L^^x G 2?2; however, their intersection Lm,m is not in 2?2, be- 
cause its projection 3iL,n,m = {a™6™} is not regular (i.e., in Vi = JVi), contradicting 
the closure under projection established above. Obviously, the proof generalizes to any 
n > 2. Notice that L^.x is synchronous, hence 2?2 is not closed under intersection even 
with synchronous languages. 

Since T>n is closed under complement but not under intersection, it is also not 
closed under union by De Morgan's laws: Li n L2 = Li U L2- However, if Li, L2 G 
Vn then Li U L2 G Afn, because a nondeterministic automaton can recognize Li and 
L2 in parallel. 
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Fischer and Rosenberg showed f6', Sec. 3] that X>„ is not closed under concatena- 
tion, Kleene closure, or reversal. The proof uses the three simple 2-word languages 

E = {{a, a), {b, b)}, G = {(c, c)}, H = {(a, e), {b, e)}. Cleai'ly, 

E*GH* ^{{xcy,xc) \ x,y e {a,b}*} £ V2 ; 

because recognizing E*GH* amounts to comparing the words on the two tapes up to 
the character c; however, the concatenation 

E*GH* o E*GH* = {{xicyiX2cy2,xicx2C) \ xi,X2,yi,y2 e {a,b}*} 

is not in 2?2, intuitively because a deterministic automaton cannot "guess" when j/2 
ends and X2 begins (formally, a counting argument similar to the pumping lemma of 
regular languages shows that a deterministic automaton must misclassify some words). 
This implies that T>2, and hence 2?„, is not closed under concatenation. A similar 
arguments that considers arbitrary concatenations of E*GH* proves that 2?2 is not 
closed under Kleene closure, either. 

To show non-closure under reversal, take the language H*E* = {xy,y \ x,y £ 
{a, b}*}, which is accepted by a nondeterministic automaton in J\f2 that guesses when 
X ends in xy. A modification of the argument used for E*GH* o E*GH* ^ 2?2 proves 
that H*E* is not recognizable with a deterministic automaton. However, rev{H* E*) = 
E*H* clearly is in 2?2; in all 2?2, and 2?„, is not closed under reversal. 



5.2.2 Nondeterministic One-Way Automata 

Let us consider the closure properties of the class Nn — NFA(n, 00, 0), for n > 2. 

Mn is closed under projection, using the same construction discussed in Section 5.2.1 
for deterministic automata: given an n-tape automaton A, build an n — 1-tape automa- 
ton B that replicates A's behavior on all tapes except the k-th (which is projected out), 
where it behaves nondeterministically (that is, it performs any computation A may 
perform on the k-th tape). Hence if i e Mn then 3fcL G JVn-i- 

Mn is closed under union; Elgot and Mezei gave fSl the first proof of this fact (us- 
ing a different formalism, ultimately corresponding to one-way multi-tape automata), 
which generalizes the construction for 1-tape automata: a nondeterministic automaton 
checks all components of a finite union in parallel through nondeterministic choice, and 
accepts if and only if at least one parallel computation accepts. Similarly, the classic 
constructions for 1-tape automata are applicable to n-tape automata to prove that Mn 
is closed under concatenation, Kleene closure, and reversal. 

Like 2?„, Mn is not closed under intersection. The proof is the very same as in the 



deterministic case: and L^.x (Section 15. 2. lb are in M2 (even in 2?2), but their in 



tersection „ is not in M2 because its projection on either component is not regular, 
whereas Mn is closed under projection. 

Closure under union and non-closure under intersection imply, through De Mor- 
gan's laws, that Mn is not closed under complement. 

Finally, Mn is not closed under generalization. The proof uses the following lemma 
proved by Monks ifTSl Th. 4]: for every n-word language L in Mn there exists an 
(n + l)-word language L' in Vn such that L = 3iL'. The proof gives an effective 
construction that turns an automaton accepting L into a deterministic automaton ac- 
cepting L' over an extended alphabet, which can be projected out to obtain the original 
set L of n-words. Now, consider L„i and L^.x again; both are in 2?2 and, since P2 is 
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closed under complement, their complements L„i and L^^x also are in D2, hence in A/2 
a fortiori. M2 is closed under union, thus the language 



L\j — L„i U x 

is also in A/2- Therefore, the lemma we just stated ensures the existence of another 

language in such that Eliiy equals Ly; since Ly G I?3, its complement Ly is 
in I?3 as well. Now, notice that the complement Ly of Ly is equivalent to 



which we noted is not in A/2 ■ If Mn were closed under generalization, 



Vliy — 3lLy — Ly 

would be in A/2, which we noted is not the case. In all, A^„ is not closed under gener- 
aUzation. 

5.2.3 Deterministic Rewind-Bounded Automata 



Let us consider the closure properties of the class 72P„ — DFA^n, 00, 00 j , for n > 2. 

7?P„ is closed under complement, since each pass of a rewind automaton on the 
input tapes corresponds to a computation of an automaton in 2?„, which is closed under 
complement. Hence, it is sufficient to adapt the usual construction for complementation 
in the following way: after every pass, accept if the original automaton rejects, reject 
if the original automaton accepts, and rewind if the original automaton rewinds. 

TZDn is closed under union: given an automaton Ai e TZDn accepting Li and an- 
other automaton A2 G TU^n accepting L2, an automaton A accepting Li U L2 operates 
as follows: simulate Ai; if Ai accepts A also accepts; otherwise, A rewinds, simulates 
A2, and accepts iff A2 does. Notice that termination is not a problem because the fi- 



nal part of Section 5.1.2 discussed why we can assume that the number of rewinds is 
always bounded. 

Closure under union and complement imply closure under intersection for T?Dn 
through De Morgan's laws. Alternatively, we can produce a direct construction similar 
to the one for union, where the simulation of two automata Ai , A2 accepts iff both 
simulations accept. 

Not only is TZDn closed under all Boolean operations; Rosenberg proves 1 18 Th. 8] 
that every language in TZDn is expressible as a finite Boolean combination of languages 
in T>n (essentially, each of finitely many rewinds represents a one-way deterministic 
computation over the input), hence TZDn is the Boolean closure of 2?„. 

TZDn is not closed under concatenation, because we have already observed in Sec- 
tion 5.1.4 that the languages B and C are in T>2 (hence in TZD2 a fortiori), but their 
concatenation A = B oC is not in TZD2 because accepting it requires nondeterminism. 
(As usual, the result immediately carries over to TZDn)- 

Since, however, rev{A) — {{b^ax, 6™) | to g F, x € {a, b}*} clearly is in TZD2, 
we conclude that TZDn is not closed under reversal either. 

TZDn is not closed under Kleene closure; Rosenberg's proof Iil8i Th. 8] works as 
follows. Consider the language 

D = {(6™c,6™) I m e M} ; 
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clearly D E TZD2 (actually, even D G 2?2)- Then, the same argument showing BoC not 
in T?D2 proves that B o D ^ TZD-z- Assume by contradiction that TU^z is closed under 
Kleene closure; then, since TU^z is closed under union and intersection, the language 

A' = (BU D)* n {B o {{a, by)" ° {(c, e>}) (27) 

also is in 7?P2- This is a contradiction, because A' equals B o D — as the B in the 
right-most argument of n in ( p7| ) forces B to appear first, and the closing (c, e) forces 
D to appear second and last — ^but we know that B o D ^ T?D2- 

We can prove that 7?P„ is not closed under projection using the language Lm.m = 



Lm n Lx^x defined in Section 5.2.1 We know that both Lm and L^^x are in I?2, hence 
their intersection Lm,m is in 7?2?2 (it is easy to build an automaton in TZD2 that accepts 
Lm.m with one rewind). The projection 3iLm,m = W™', is, however, not in 7?Pi 
because it is not regular and 7?Pi — A/i. 

Finally, 7?P„ is not closed under generalization, because it is closed under comple- 
ment but not under projection. 



5.2.4 Nondeterministic Rewind-Bounded Automata 

Let us consider the closure properties of the class TiAfn — NFA^n, oo, oo^ , for n > 2. 

Using rewinds, the same constructions that show TZDn closed under intersection 
and union are applicable to show TlAf n is closed under intersection and union: use one 
rewind to execute the two computations for Li and L2 in parallel; accept if both accept, 
when recognizing Li n L2; accept if at least one accepts, when recognizing Li U L2- 

TiAfn is not closed under projection, with the same proof we have used in several 
other cases: Lm.m is in 1^2, but 3iLm.m = {a^fe™} is not in TiAfi because it is not 
regular and ^Z^fl = Afi . 

TiAfn is not closed under complement either. The proof is a modification of Chan lH 
Th. 4.6]: consider the language 



L-,i,.m — ' 



Ul * Wi# • • • #M 



/ Ml, ■ 
Vi,. 

V yi, 



. . , M. 

■ 7 7 
• ■ 1 '^n 7 

■ ,yn 



Vj, j : Ui 



) 



e{0,i}+ 



L^i,,m essentially is the complement of L^,^m, but we can show that L-,i,^m ^ 7?A/^2 
whereas L*.,„ G TiN2- Intuitively, rewinds do not help in recognizing L^^m or L^i,^m, 
as m and n can be arbitrarily large, whereas a finite-state automaton can only "remem- 
ber" a finite number of position to jump to after any rewind; nontdeterminism works to 
recognize Li,,m but is still insufficient for L-,i,^m where "universal" nondeterminism is 
needed. Formally, assume by contradiction that L-,i,,m G 7?A/^2 for some automaton A 
with r rewinds. Then, modify A into A' so that A' works on inputs of the form 

(a;i#.T2# • • • #.Tr+2, yi#y2# • • • #yr+2) 
as A would work on inputs of the form 

(a :*r Xi#a^ -k X2# ■ ■ ■ #0^^"^ -k Xr+2, of^'^ * 2/i#a''^^ * y2# ■■■j^a-k y^+2) 7 

by having enough states to count a's up to r + 2. Therefore A' recognizes io/i.m 
with r rewinds, contradicting the fact that io/^ is not in NFA(2, cx), r). Since m is 
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generic, the contradiction shows that L^i,,„i ^ TiM2, then TiNn is not closed under 
complement. 

TiNn is closed under concatenation, Kleene closure, and reversal, through the usual 
constructions that exploit nondeterminism mentioned in Section [5. 2. 2| 

Finally, whether TiNn is closed under generalization is an open problem. 

5.2.5 Reversal-Bounded Automata 

The proof that establishes the non-closure under projection of automata with rewinds 
(by reduction to the 1-tape case) entails the non-closure under projection of automata 
with generic reversals in NFA(n, oo. r) and NFA(n, oo, r), for any n > 2 and R > 0. 
Since non-closure under projection of a class of automata is tantamount to undecidabil- 
ity of emptiness for automata of that class, we do not proceed further with the investi- 
gation of the closure properties of two-way automata (which have not been studied in 
the literature either). 

5.3 Decidability 

This section discusses the decidability of various problems for multi-tape automata. 
5.3.1 Deterministic One- Way Automata 

Let us consider a generic member A of the class 2?„ = DFA(n, oo, 0), for n > 2. 

Emptiness is decidable, as a corollary of the fact that the projection of A ^ 2?„ 
is in Afn-i, which is closed under projection. Thus, C{A) is empty if and only if 
3tj3f2- • • 3t^_-^C{A) is empty, where <i, . . . ,t,i-i is any subset of {!,... ,n} with 
n — 1 elements; the latter problem is decidable because emptiness of regular languages 
is decidable. Notice that the projection automaton is effectively constructible from A. 
Another proof of the same decidability results uses an analogue of the pumping lemma 
for multi-tape automata: Rosenberg 1 17| shows that, given a partition Qi U • • • U Qn — 
Q of A's set Q of states, C{A) ^ if and only if A accepts some input {xi, . . . , Xn) such 
that \xi\ < \Qi \ for all 1 < i < n. Since I?„ is closed under complement, universality 
is also decidable for A £ I?„. 

The property of projection also shows that finiteness is decidable for A £ T>n'. 
C{A) is finite if and only if 3ti^t2 ' ' ' 3t„_i>C(A) is finite for every subset ti, . . . , t„_i 
of {1, . . . ,n} with n — 1 elements; the latter problem is decidable because finiteness 
of regular languages is decidable. 

The problem of whether equivalence is decidable for A G I?„ has been open for 
several years; Harju and Karhumaki |8| have finally shown it to be decidable. Their 
proof is quite technical, and it is basically a corollary of the related problem of "multi- 
plicity equivalence" for nondeterministic one-way multi-tape automata. Two automata 
in Afn are multiplicity equivalent if they accept the same n-words exactly the same 
number of times (that is with the same number of distinct computations). Using some 
group-theoretic techniques, Harju and Karhumaki show that the multiplicity equiva- 
lence problem is decidable for automata in JVn, hence also for automata in 2?„. The 
multiplicity equivalence problem reduces, however, to (ordinary) equivalence for de- 
terministic automata in 2?„, which have at most one computation on each input. 

Rabin and Scott |16 Th. 18] have shown that disjointness is undecidable for au- 
tomata in P2; as usual, the proof immediately generalizes to 2?„ with n > 2. The 
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proof is a simple reduction from Post's correspondence problem: given a finite set of 
2- words over S (with IS] > 2) 

{{Xi,yi),{x2,y2),---,{xm,ym)} , 

determine if there exists a sequence ii,i2, ■ ■ ■ ,ik of indices from 1, . . . , to (possibly 
with repetitions) such that 

The reduction is as follows: consider the (finite) 2-word languages 

X = {(a;i,l),...(a;„,TO)}, 
Y = {(yi,l>,...(t/™,TO)}. 

Obviously, X* and Y* are both in 1)2, but the given instance of Post's correspondence 
problem has a solution if and only if X* Y* 7^ 0. Since Post's correspondence 
problem is undecidable, disjointness for 2?2 (and 2?„) is also undecidable. 

The undecidability of the inclusion problem for 2?„ follows from the fact that I?„ 
is closed under complement but disjointness is undecidable for it; in fact, A C B ^ (d 
if and only ifACB. 

5.3.2 Nondeterministic One-Way Automata 

Let us consider a generic member A of the class Afn — NFA(n, 00, 0), for n > 2. 

The proof of decidability of emptiness and finiteness for 2?„ does not depend on 
the restriction on deterministic automata, and in fact establishes that the same problems 
are decidable for Mn as well. 

Conversely, undecidability results for I?„ immediately extend to its superclass Af^, 
thus disjointness and inclusion are undecidable for Afn as well. 

Universality is undecidable for Afn', Fischer and Rosenberg |6 Th. 7] give an- 
oth er proo f using reduction from Post's correspondence problem (introduced in Sec- 
tion 



5.3.1 



X* n y * = if and only if X* U F* = if and only if X* (JY* ^ (S* )2, 

which is the universality problem for a language in A/2 (remember that Afn is closed 
under union). 

Now, notice that there exist an automaton Aij in I?„ (hence also in Afn) that ac- 
cepts the universe language (S*)". Since deciding the equivalence C{A) — £{A(j) is 
equivalent to deciding the universality problem for a generic A E Afn, it follows that 
equivalence is also undecidable for Afn- 

Finally, deciding whether a generic language L E Afn is deterministically recog- 
nizable (i.e., L E Vn) is also undecidable, with a more complex reduction from Post's 
correspondence problem 16) Th. 9]. 

5.3.3 Deterministic Rewind-Bounded Automata 

All decision problems considered in this paper are undecidable for the class TZDn = 

DFA^n, 00, 00^ , for n > 2. This is a consequence of the non-decidability of some 

problems for the class I?„, of which 7?P„ is a strict superset, combined with the closure 
of 7?2?„ under all Boolean operations. 

Consider, for example, the emptiness problem for 7?P„; if it were decidable, then 
the disjointness problem for generic A,Be I?„ would be decidable by reducing it to 
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testing the emptiness of ^ n i? G 7?P„. But Section 5.3.1 showed that disjointness 
is undecidable for 2?„. Since 7?P„ is closed under complement, universality is also 
undecidable for 7?P„. 

Emptiness is reducible to finiteness as follows. Assume, a contrario that finiteness 
is decidable for 7?P„; then, we can decide whether C{A) — for a generic A £ 
TZDn- First, determine if A accepts a finite or infinite language; if it accepts an infinite 
language, we conclude that C{A) is not empty; thus, let C{A) be finite. Modify A 
into A' by adding a loop on every accepting state of A\ the loop reads some cr € E 
and moves the head right on every tape. It should be clear that, for every n-word 
(xi, . . . , Xn) accepted by A, A' accepts all (infinitely many) words in 

{(xia",X2(T",...,x„a™) I me M} . 

We have that A' accepts a finite language if and only if C{A) is empty, but emptiness 
is undecidable for a generic A £ Wn ■ 

Disjointness is undecidable for 7?P„ because the universe language (S*)" is in 
TZDn, and deciding disjointness of C{A) and (E*)" is equivalent to deciding emptiness 
of C{A). Similarly, C{A) C if and only if C{A) = 0, hence inclusion is also 
undecidable for TZDn- Finally, equivalence is a generalization of emptiness, thus it is 
undecidable for TZDn- 

5.3.4 Other Two- Way Automata 

The undecidability of all decision problems for TZDn propagates up the hierarchy: all 
decision problems are undecidable for TiAfn, as well as for generic two-way automata. 



6 Summary of Properties 

Figure |2] summarizes the known inclusion between classes of multi-tape automata. 
Solid lines denote strict inclusions and dotted lines denote weak inclusions; namely, it 
is unknown whether nondeterminism increases the expressive power of asynchronous 
multi-tape automata with unbounded reversals. 

Table [T] summarizes the known closure properties of synchronized multi-tape au- 
tomata (syn), deterministic asynchronous one-way (dal), nondeterministic asynchronous 
one-way (nal), deterministic asynchronous with reversals (dar), and non determinis- 
tic asynchronous with reversals (nar), with respect to complement ^, intersection n, 
union U, projection 3, generalization V, concatenation o, Kleene star *, and reversal 
rev. "Y" means closure, "N" means non-closure, "n" denotes closure within the next 
class, and "?" means open problem. 

Table |2] shows which problems are decidable ("Y") and which undecidable ("N") 
for the same classes of multi-tape automata. 
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Table 1: Closure properties of multi-tape automata. 
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Figure 2: Relative expressiveness of multi-tape automata classes. 
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syn dal nal dar nar 
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Table 2: Decidability properties of multi-tape automata. 
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7 Intersection of Asynchronous Automata 



This section describes an algorithm for the intersection of muhi-tape nondeterministic 
asynchronous one-way finite-state automata. Since these are not closed under intersec- 
tion, the algorithm may not terminate (or, equivalently, it may define an infinite-state 
automaton as result). We use a slightly different definition of multi-tape automaton, 
which is easily seen equivalent to Definition [T] in the one-way case. 

Definition 3. An n-tape finite-state automaton A is a tuple (E, T, Q, t, 5, Qq, F) where: 
E is the input alphabet, with < ^ E; T = {^i, . . . , t„} is the set of tapes; Q is the fi- 
nite set of states; t : Q T assigns a tape to each state; S : Q x E<| -> p(Q) is the 
(nondeterministic) transition function; Qq Q Q are the initial states; C Q are the 
accepting (final) states. 

Whenever convenient we will represent the transition function (5 as a relation, that 
is the set of triples (q, a, q') such that q' E S{q, a). 

Consider two asynchronous automata A = {T., Q"^ , 5^ , Qq , F"^ , t^) andB = 
{Y;,Q^,S^,Q^,F^,T^,T^), such that A has m tapes T"^ ^ {t^,...,t:^} and B 
has n tapes = {tf , . . . We now describe an algorithm that computes the 

intersection C = A n B of A and B, where C = (E, Q, S, Qq,F, T, t); C's tapes 
T are the union of and T^. To describe the algorithm, we introduce repeated 
operations as separate routines. All components of the algorithm have access to the 
definitions of A and B and to a global stack s where new states of the composition are 
pushed (when created) and popped (when processed). 

Routine asyncjiext takes a t-tape automaton D (i.e., A or B) and one of its states 
q, and returns a set of tuples {q' , hi, . . . , ht) of all next states reachable from q either 
directly or by accumulating delayed transitions hi G [6^)* in tape t;, for \ < i < t. 
We call delayed states such tuples of states with delayed transitions. The search for 
states reachable from q stops at the first occurrences of states associated with a certain 
tape. Figure [3] shows the pseudo-code for asyncjiext . 

Consider now a pair of delayed states {p,hi, . . . , hm) and {q,ki, . . . , fc„), respec- 
tively for automata A and B. The two delayed states can be composed only if the 
delays on the synchronized tapes are pairwise consistent, that is the sequence of input 
symbols of one is a prefix (proper or not) of the other's; consihi, ki) denotes that the 
sequences hi, ki of delayed transitions are consistent. Routine new states (in Figure|4]l 
takes two sets P, Q of delayed states and returns all consistent states obtained by com- 
posing them, newstates also pushes onto the stack s all composite states that have not 
already been added to the composition. For convenience, newMate also embeds the 
tape t of each new composite state within the state itself. 

It is often convenient to add arbitrary prefixes to the delays of delayed states gen- 
erated by new states . To this end, routine compose -transition (in Figure |5]l takes two 
sets P, Q of delayed states and an (to + n)-tuple of delays, and calls new_states on 
the modified states obtained by orderly adding the delays to the states in P and Q. It 
also adds all transitions to the newly generated states to the transition function S of the 
composite C. 

We are ready to show the main routine intersect which builds C from A and B. 
Since the intersection may have infinite states, intersect takes as arguments a bound 
on the maximum number of states and on the maximum delay (measured in number of 
transitions) accumulated in the states. 
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1 asyncjiext (D, q) : SET [(g', hi,. . . , /it)] 



2 (J is always reachable from itself 

3 Result := {(g, e, e)} 

4 — for every tape other than q's 

5 for each U e {tf , . . . ,tf}\ T^{q) do 

6 P := all shortest paths p from q to some q such that: 

7 (g) = and no state g with (g) = appears in p before q 

8 each element in P is a sequence of transitions 

9 for each ei • • G P do 

10 hi,...,ht:=e 

11 each transition is a triple (source, input, target) 

12 for each {qi,a, 52) G ei • • • Cm do 

13 — add the transition to the sequence corresponding 

14 to its source's tape 

15 Ko{qi) ■= KD(qi) + (gi,Cr, 52) 

16 — 52(6771) is the target state of the last transition 67,7 

17 Result := Result U(g2(er7i), hi,.. . , hf) 



Figure 3: Routine asyncJiext. 



1 new states (P: SET[{p, hi,..., hm)l Q: SET[{q, ki,..., A;„)]): S 

2 5 := 

3 for each {p, hi,..., hm) G P, {q,ki, . . . ,kn) G Q do 

4 if delays on synchronized tapes are consistent 

5 if Vi G n : consihi, h) then 

6 for each f e T do 5 := 5 U {{p, q,t,hi,. . . , hm, ki,..., A;„)} end 
7 Here Q denotes C"s set of states , not the input argument 

8 for each reS do rtr^Q then s.push (r) end 

Figure 4: Routine new states . 



1 compose Jransition (P: SET[{p, hi, ... , hm)], Q- SET[{q, ki, . . . , kn)], 

2 d: ihi,...,hm,ki,...,kn),cT,r) 

3 Ja ■■= {{p, hih[,...,hm h'm) I {p, h[, h'm) G P} 

4 JB:={{q,kik'^,...,kM I {q,k{,...,k'^)&Q} 

5 5 := newj^atej {J a, Jb) 

6 for each r' G 5 do ^ := ^ U {r, a, r'} end 



Figure 5: Routine compose Jransition . 
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1 intersect ( max_states , maxjdelay) 



2 Q:=0;s:=0 

3 — ^'s initially reachable states 

4 J A '■= UiG/^ asyncjiext (A, i) 

5 — i?'s initially reachable states 

6 Jb -—[ji^jg asyncjiext (B, i) 
1 S := newstates {J a, Jb) 

8 — mark these states as initial 

9 I -.= 8 

10 until s = or IQI > maxstates loop 

11 r ■.= (qa,qb,t,hi,...,hrn,ki,...,kn) = s.pop 

12 if Vd e {/ii, . . . , kn} ■ \d\ < max-delay then 

13 Q:=QU{r} 

14 else continue 

15 Q:=QU{r} 

16 if t e n then 

17 event on shared tape 

18 if /it = {ua, (J, u'Jht and /cj = {ub, a, u'^)kt then 

19 — delayed transition on both A and B 

20 P := asyncjiext (A, qa) 

21 Q := asjnc-nex/ (-B, q^) 

22 := (/ii, ...,ht,..., hm, ki,. .. ,kt,.. . ,kn) 

23 compose Jransition (P,Q,d,a,r) 

24 elseif /it = {ua, cr, u'g)ht and kt = e then 

25 — delayed transition on A 

26 P := asyncJiext {A,qa) 

27 normal transition on B 

28 Q := { asyncjiext (B, q'^) \ [qi,, a^, q^) G A a = ai,} 

29 d:= {hi,...,ht,...,hm,ki,...,kn) 

30 compose Jransition {P,Q,d,a,r) 

31 elseif ht = e and kt = {ub, a, u'f^)kt then 

32 — delayed transition on B 

33 Q := asyncjiext (B, qjj) 

34 normal transition on A 

35 P '■={ asyncjiext {A, q'J \ {qa, aa, q'J Aa = aa} 

36 d := {hi, .... /i,„, ^i, . ■ . ,kt, . . . ,kn) 

37 compose Jransition (P,Q,d,a, r) 

38 elseif ht = h = e then 

39 for each u G S do 

40 normal transition on both A and B 

41 P ■= { asyncJiext {A, q'J \ {qa, aa, q'a) e 6^ A aa = a} 

42 Q ■= { asyncJiext (B, q'^,) \ {qb, ab, q'h) € A ab = a} 

43 d:= {hi,...,h„i,ki....,...,kr,) 

44 compose Jransition {P,Q,d,a,r) 

45 elseif teT^\T^ then 

46 event on ^'s non— shared tape 

47 if /it = {ua, a, u'a)ht then 

48 — delayed transition on A, B stays 
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49 P := asyncjiext (A, Qa) 

50 Q:={{qb,e,.^,e)} 

51 d := (hi, . . . ,ht,. . ., hm, h,. .. , kn) 

52 compose Jransition (P,Q,d,a, r) 

53 elseif ht = e then 

54 — normal transition on A, B stays 

55 Q := {{qb,e,...,e)} 

56 for each a e S do 

57 P ■={ asyncjiext (A, q'J \ {qa, cra,q'a) Aaa = (j} 

58 d := {hi, . . . ,hm,ki, . . . ,kn) 

59 compose Jransition (P,Q,d,a, r) 

60 elseif teT^\T^ then 

61 — event on i?'s non— shared tape 

62 if kt = {uh,(T,u',^)kt then 

63 — delayed transition on B, A stays 

64 P:={{qa,e,...,e)} 

65 Q := asyncjiext (J5, gf,) 

66 d:= {hi,...,hm,ki,...,kt,...,kn) 

67 compose Jransition (P,Q,d,a,r) 

68 elseif h = e then 

69 normal transition on B, A stays 

70 P:={{qa,e,...,e)} 

71 for each cr e E do 

72 Q ■= { asyncJiext (B, q'^) \ {q^, ab, q^) € A at = a} 

73 d:= {hi,...,hm,ki,...,kn) 

74 compose Jransition {P,Q,d,a, r) 
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